Search for: All records

Behavior constrained policy optimization has been demonstrated to be a successful paradigm for tackling Offline Reinforcement Learning. By exploiting historical transitions, a policy is trained to maximize a learned value function while constrained by the behavior policy to avoid a significant distributional shift. In this paper, we propose our closed-form policy improvement operators. We make a novel observation that the behavior constraint naturally motivates the use of first-order Taylor approximation, leading to a linear approximation of the policy objective. Additionally, as practical datasets are usually collected by heterogeneous policies, we model the behavior policies as a Gaussian Mixture and overcome the induced optimization difficulties by leveraging the LogSumExp’s lower bound and Jensen’s Inequality, giving rise to a closed-form policy improvement operator. We instantiate both one-step and iterative offline RL algorithms with our novel policy improvement operators and empirically demonstrate their effectiveness over state-of-the-art algorithms on the standard D4RL benchmark. Our code is available at https://cfpi-icml23.github.io/. 

The twisted stacking of two layered crystals has led to the emerging moiré physics as well as intriguing chiral phenomena such as chiral phonon and photon generation. In this work, we identified and theoretically formulated a non-trivial twist-enabled coupling mechanism in twisted bilayer photonic crystal (TBPC), which connects the bound state in the continuum (BIC) mode to the free space through the twist-enabled channel. Moreover, the radiation from TBPC hosts an optical vortex in the far field with both odd and even topological orders. We quantitatively analyzed the twist-enabled coupling between the BIC mode and other non-local modes in the photonic crystals, giving rise to radiation carrying orbital angular momentum. The optical vortex generation is robust against geometric disturbance, making TBPC a promising platform for well-defined vortex generation. As a result, TBPCs not only provide a new approach to manipulating the angular momentum of photons, but may also enable novel applications in integrated optical information processing and optical tweezers. Our work broadens the field of moiré photonics and paves the way toward the novel application of moiré physics.

 

Miniaturized spectrometers in the mid-infrared (MIR) are critical in developing next-generation portable electronics for advanced sensing and analysis. The bulky gratings or detector/filter arrays in conventional micro-spectrometers set a physical limitation to their miniaturization. In this work, we demonstrate a single-pixel MIR micro-spectrometer that reconstructs the sample transmission spectrum by a spectrally dispersed light source instead of spatially grated light beams. The spectrally tunable MIR light source is realized based on the thermal emissivity engineered via the metal-insulator phase transition of vanadium dioxide (VO₂). We validate the performance by showing that the transmission spectrum of a magnesium fluoride (MgF₂) sample can be computationally reconstructed from sensor responses at varied light source temperatures. With potentially minimum footprint due to the array-free design, our work opens the possibility where compact MIR spectrometers are integrated into portable electronic systems for versatile applications.

 

We applied localized orbital scaling correction (LOSC) in Bethe–Salpeter equation (BSE) to predict accurate excitation energies for molecules. LOSC systematically eliminates the delocalization error in the density functional approximation and is capable of approximating quasiparticle (QP) energies with accuracy similar to or better than GW Green’s function approach and with much less computational cost. The QP energies from LOSC, instead of commonly used G 0 W 0 and ev GW, are directly used in BSE. We show that the BSE/LOSC approach greatly outperforms the commonly used BSE/ G 0 W 0 approach for predicting excitations with different characters. For the calculations of Truhlar–Gagliardi test set containing valence, charge transfer, and Rydberg excitations, BSE/LOSC with the Tamm–Dancoff approximation provides a comparable accuracy to time-dependent density functional theory (TDDFT) and BSE/ev GW. For the calculations of Stein CT test set and Rydberg excitations of atoms, BSE/LOSC considerably outperforms both BSE/ G 0 W 0 and TDDFT approaches with a reduced starting point dependence. BSE/LOSC is, thus, a promising and efficient approach to calculate excitation energies for molecular systems.